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Conqparis^xi of CEAS and WUllams-type Models for Spring VAieat Yields In 
North Datota and Minnesota. By Tom L. Barnett; N.A.S.A.. Yield Model 
Development Center, Columbia, Missouri; March, 1982. 


ABSTRACT 


The CEAS and WUllams-type yield models are both based on multiple 
regression analysis of historical time series data at CRD level. The CEAS 
model develops a separate relation for each CRD; the WUllams-type model 
pools CRD data to regional level (groi\pa of similar GRDs). Basic variables 
considered in the analyses are USDA yield, monthly mean temperature, 
monthly precipitation, and variables derived from these. The WUllams-type 
model also used soU texture and topographic Information. Technological 
trend is represented In both by plecevise linear functions of year. 
Indicators of yield rellabUlty obtained from a ten-year bootstrap test of 
each model (1970-1979)) demonstrate that the models are very slmUar In 
performance in all respects. Both models are about equally objective, 
adequate, timely, single, and inexpensive. Both consider scientific 
knowledge on a broad scale but not in detail. Neither provides a good 
current measure of modeled yield reliabUity. The CEAS model is considered 
very slightly preferable for A^ISTARS applications. 


Key words ; Model evaluation, yield modeling, linear regression. 
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Comparison of CEAS and Williams-type 
Spring Wheat Yield Models for tJorth Dakota and Minnesota 

Suwnary of Conclusions a nd Reoomme>idatioins 

Ihe CEAS yield model for spring v^heat is more accurate, nore precise, 
and more responsive to actual yield variations than is the WUliams-type 
model by a small but consistent factor* This, advantage liolds for CBD, 
state, and regional yield estimates. The models appear to be e<;iually 
objective, adequate, timely, Inexpensive, and simple. Both Incorporate 
scientific knowledge on a broad scale to about the same degree. Neither 
provides a useful current estimate of modeled yield reliability. The CEAS 
yield model appears to be the moat appropriate model for use In the 
AgEISTARS Fiscal Year 8l Pilot Tests for spring wheat in North Dakota and 
Minnesota. 

a 

Applications Description 

Testing and evaluation of candidate crop yield models for use with par- 
ticular crops in particul,ar geographical regions are major tasks within the 
Yield Model Developmant Project of the AgRISTARS Program. A YMD docufet 
(W. W. Wilson, T. L. Barnett, S. K. LeDuc, F. B. Warren, "Crop Yield 
Project, Document YT® - 1 - 1 - 2 (30 .-2.1) establishes a conmon reference 
for describing yield model performance and criteria for evaluation. 

Two yield models for spring wheat were evaluated and compared. The 
first, the CEAS Model, was de'/eloped by the Center for Environmental 
Assessment Services (CEAS), and MOAA center In Columbia, Missouri, (LeDiic, 
S.K.). The second, the Willlams-type Model, was developed by the Yield 
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r4od9l Devrelopment 9roup at Columbia^ Missouri based on an analytical model 
for Canadian cereal sralns. described by 0. 0. V, Williams (Q. D. V, 
Williams, M. X. Joynt, P» A* McCormick, "Regression Analysis of Canadian 
Prairie Crop-District Cereal Yields, 1961-1972, In Relation to Weather, 
Soil, and Trend, "Can. j. .Soli Scl. 55; Peb. 1975). 

these tv«9 predictive ttodels were evaluated according to the above men- 
tioned criteria for potential applicability In the AgRISTARS Fiscal Year 81 
Pilot Tests on spring wheat In fferth Dakota and Minnesota. Results of the 
individual model tests are described in the forthcoming YfO documents 
"Evaluation of the CE^ ‘teid and Monthly Weather Data Models for Spring 
I'/heat Yields In ‘forth Dakota and Minnesota" and "Evaluation of 
WUllains-Tyoe Spring Wheat Model In Morth Dakota and Minnesota." The 
current document son^sares the results of performance tests on the two 
models and makes recomnendatlons as to which model is best suited for 
current Ag^HSTARS Pilot Test needs. 

Review of Models 
CEAS MODEL 

Basic Inputs to the model were historical rjSDA yields and monthly mean 
terrpepature and total precipitation at the Crop Reporting District (CRD) 
level. A wide variety of possible weather-related variables, such cumula- 
tive precipitation from the previous September, monthly temperature and 
precipitation departures from normal and evapotransplratlon (potential, 
actual, and "clLmatlcally appropriate") were formed from the basic Inputs. 
Trends, accounting for ganeral Improvements In technology over the years, 
were defined. 
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Linear functlone of tiie year nuinber are ueetl an eurrogatea for tech- 
nology In all mo<lels. single trend term for all of the Kli'iktesota 
models allows a linear increase in yield between 1955 and 1978. 
Contributions to yield from tedviology are considered for possible inclu- 
sion in the North Dakota moiiels* One allows a linear increase in yield 
betweeti 1955 and 1966, the next a linear Increase between 1966 and 1973* 
and the last a linear Increase frotn 1973 on. The first trend term, between 
1955 arid 1966, is included in all of the fbrth Dakota models. The second 
term, between 1966 and 1973* is included only in the model for ND CRD 90. 
The third trend term is not Included in any moilel . The contribution to ^ 
yield from technology is considered nil for any time period not covered by 
an included tre^id term. 

> 

The general form of the CEA3 yield model was; 

Yi ■ a + b TRSNDli + b* 'I!©JD2i + b” TREND3i ^ 2” 

lc»l 

where; 

A 

'll ■ estimate of yield for 1-fch year 
a ■ Intercept (constant term) 

b b’b” ■ linear trend coefficients 

\ ■ slope coefficient associated with the Ic-th weather term 

Wii^ ■ weather term for the 1-th year 
In developing the models for each CRD (MIT CRD's iO and 40, MD CRD’s 10 
through 90) and state (MN and ND) stepwise multiple regresslois were run to 
exainlne the possible variables and seltsct the statistically moat slgilfl- 
cant set of several trend and weather terms on the l»8l3 of years 
1932-1973 for ITD and 1936-1978 for MN. A certain amount of Judgement was 
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U 80 d to eliminate tornis obviously in conflict with scientific IcioWIedse 
(e.gtt when a coefficient was strongly negative v^ere it should be 
positive) or to include In^rtant terms even if ^y were not statistically 
sigiif leant. Model terms and ranges of coefficients over tlie ten test 
years are given in the CEAS spring lAieat model evaluation document 
referenced above. 

WILLIAMS-TyP E MODEL 

In the models for Canadian wheat de/’eloped by G. D. V. William, barley 
and rye crop district weather and agronomic data were pooled to larger soil 
color regions. Soil texture and topographic Information were Incorporated 
along vdth trend and weather* A predictive yield model for barley in fiorth 
Datota (ND) and Minnesota, (MN) based on the concepts outlined by Williams 
f'y. al., was developed and tested by the AgRISTAftS Yield Model Development 
Group. The tnodel incorporated CRD-level weather (monthly mean teirperature 
and total precipitation), soil texture “jnd topography in a manner similar 
to that used by Williams. The CRD-level data were pooled to the following 
two more-or-lass environmentally homogeneous regions: 

(a) Red River Valley (J4NRR) -consisting of ND CRD's 30 and 60 and MN 
CHD's 10 and 40; 

(b) The remainder of North Oalcota (NDREM) -consisting of NP CRD*s 10, 
20, 40, 50, 70, 80, and 90. 

Separate models were developed for the two regions to provide predictions 
of CRD yields using ijidlvldual CRD weather/soil data ’,ylth coefficients from 
the pooled model. Msdels were also developed for the two states, ND end 
Mt’I, based on state-aggregated weather/soil data. 
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Models were developed on the basis of data from 1932 throu^ 1979. The 

terms were selected from stepwise regressions frotn (^^Ich the most sl®il?l- 

cant ten (or fewer) terms ^/^re retained far each region* A limit of 10 

terms had been used by Williams et. al. and seemed to be a ireaa<^able upper 

> 

limit in applying this method. 'Hie basic weather/soil/trend Ijipu'is were 
monthly mean tenperaturei total monthly preclpltaticHii percent of sells In 
the CRD In textural classes-coarse, medium and flnej percent of CRD area In 
the topographic classes-level to gently undulating; and year as surrogate 
for technological trend. These Inputs were used to calculate the possible 
model variables. 

Trend as defined for CEAS model 

Tx ■ .75x(^flnd soil) t ,65X Clfejedlum soil) + .35X(/5coarse soil); 

Tx squared 

Top ■ % of area level to gently undulating; 

Top squared; 

C ■ precipitation Septernber-Aprll ; 

C squared; 

S5, E6, E7 ^ potential evapotransplratlon calciilated by the 
Thorri.thwalte method (1948) for ^tay, June, July; 

D6, D7* ■ moisture deficits * E - precipitation for June, July; 

D5, D6, D7 squared; 

DO * seasonal deficit ■ D5 + D6 + D7 - C; 

00 squared; 

Tx X Do 

*D5 was not used since D5, D6, D7, C, and Do are not all nwtually Independent. 
Of these possible terms, the stepvdse regression selected ten or fewer 


terms for each region. The terms Judged to be statistically significant 

» 

and the ranges of coefficients over the ten test years are presented in the 
Wllllams-typs spring wheat .evaluation report referenced above. 
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COMPAaiSOM METHODOLOGY 

Elflit Model Characteplatlcs to be Compared 

The document referenced previously, Crop Yield Model Test and Evaluatl<j)n 
Criteria, (Wilson, et al., 1^80) states; 

’’The model characteristics to be emphasized In the 
evaluation process are; yield Indication reliability, 
objectivity, consistency with scientific Iciowledge, 
adequacy, timeliness, minimum cost, sin^licity, and 
accurate current measures of modeled yield reliability.” 

Ihe models will be compared using these characteristics.’ Each charac- 
teristic is discussed Individually 'idthout regard to the other 
characteristics. Ths present discussion makes no presunption as to the 
relative In^ortance of the characteristics. 

Quantitative Model Comparisons 
A re Based on the “Same Data r 

Direct quantitative comparison betweei models are made for two of the 
criteria, tleld Indication Reliability and Accurate Current Measures of 
■todeled Yield Reliability. The quantities Involved are derived from the 
observed yields and standard errors of prediction obtained from Independent 
bootstrap 'fast for each of ten years (1970-1979). The same base period is 
used for all models In Gorrputlng model-related values for a particular year. 

The average production and yield over the t<an year test period are 
listed In Table 1 for each geographic area, along '.vith the percent produc- 
tlon each crop reporting district (CRD) contributes it Its state and the 
fwd, state region and the percent production each state contributes to the 
region. The percentage of regional production for each CRD is shown 
graphically In Figure 1. In all the figures, darker shades Indicate higher 
productivity. 
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Separata yield predlctlorw are made for each CRD, state, and for t^e 
regions. Yield predictions and standard errors of prediction at the state 
level are alifo obtained by using a vwlghted average of that state's CRD 
model values, and yleldi values for the region are obtained using a yfslghted 
average of the values from the CRD models and from the state models. The 
weighting factor used is harvested acreage. Results obtained by a^e- 

I 

gating fro»n the CRD models are identified tn tables as "CRD aggr." results 
obtained by aj^sregatlng from the state 'todels are identified as ’’states 
aggr." 

Mod els Are Ra n ted According to Performanc e 

Models are ranked for each of the following Lidlcators of yield 
reliability (order does not Imply relative Liqxortance) ; 

(1) the bias, 

(2) the root mean square error (Rf4SS), 

(3) the standard deviation (SD), 

(4) the percent of years the absolute value of the relative difference 
exceeds tan percent, 

(5) the largest absolute value of the relative difference, 

(6) the next largest absolute value of the relative difference. 

(7) the percent of years v^lch the direction of change from the 
previous year in the x's agrees with the Y's. 

(3) the percait of years In which the direction., of cliange frotti the 
average of the previous three years In the Y's .^rees with the 
Y ’ 3 , ar,id 

(9) the Pearson correlation coefficient between the actual and pre- 
dicted yields during the Independent test years. 
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Models are also ranked according to the value of the Speaman correla- 
tion co-effloient which Indicates the utility of the model’s current 
mersure of modeled yield reliability. For the Indlcatlor (1) - (6), the 
iiiodel with the smallest numeric value exhibits the beat performance In 
terms of yield reliability and Is given a rank of 1 . Fbr the remaining 
quantities, the model with the largest value exhibits the most desirable 
performance. If models are tied for the saine level of perfonnance, they 
are all asslgied the lowest rank for Which they are tied. For example * If 
two models are tied for best performance, they are both assl^ied a rank of 
1, the lower of ranks 1 and 2, 

It stiould be remeinbered that the models are ranked only In relation to 
each other and nob to an absolute standard. Therefore, saying th&t a par- 
ticular model performs best or Is superior to or more desirable than 
another model does not necessarily Imply that the model Is the best of all 
possible models. It Is the best of only ttwse with which It Is currently 
being coitpared. 

Models ^ye Compared Using Statistical 
Itests Based on D ■ Y - Y 

i 

It is desirable to run a statistical test comparing the reliability of 
con^etlngmodels. A formal statistical test considers the variability of 
iHDdel performaiice over tline and allows ttie user to specify an upper ILmlt 
on the probability of Incorrectly declaring one model better tlaan another. 
This probability is known as a, the level of slgilflcance, or the Tsrpe I 
erroi". Howe*/er, because the models are similar, a powerful statistical 
procedure Is needed which Is able to detect; small, although ljq3ortant, dif 
ferences In reliability. Also, the test should be able to f'jnctlon well 
with relatively small samples of data Tor each model, say ten years. 
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The test should also perfortn well v^eri only tvw models afe being- 
compared. Often only two models of a particular type, for example ^ two 
mof\t}ily weather data models or two daily weather data models, are com^ 
petltlve and available for testing. When models of different types are to 
be compared, it is unlikely that all possible model comparisons will be 
made. It is more likely that the best models of each type will be 
compared. 

it woiilil appear ttiat an P teat coaid be useful In cormparlng the mean 
square errors of tv#o models. However, if the mean square errors are based 
on ten years of test .data and ■ .05, then one model’s mean square error 
must be four times larger ttian another’s before the models can be declared 
different. This is an unreasonable requirement since models which dve in 
the evaluation process will almost always be more competitive than this. 

A test may be construe te<l by considering that one model Is considered 

A 

more reliable than another model if its predicted yields, Y’s, are closer 
to the actual yields, Y’s. No difference in the reliability of two models 
for a particular year means that the absolute value of the difference bet- 
wea'i their predicted yields and the actual yield 1s the same. The ’absolute 
value of the difference is iised because it does not iHatter whether one 
model overestimates and the other underest linates or whether they both over 
or underestimate. The reliability of a model for that year is related to 
the amOijit of the discrepancy, not its direction. may define 

I 1 ■ I Yi - Y I , I d 2 I * I Y 2 - Y I , and D “ I d]_ { - I dg I . Then the models are 
equally reliable In a year for which 0 equals zero. If D is not equal to 
zero, one model is more reliable than the other for ttiat year. In formal 
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terras, we to test the nail hypothesis ttiat fc>iere is no difference In 
the reliability of the rtpdels wer all years. To do so the values of D 
from the ten test 'years rray be used to compute a test statistic and a deci- 
sion raade whether or not to reject the null hypothesis. Since the results 
for the models are paired each year, paired-sample statistical tests are 
used. 

Two tidies of paired-sample statistical tests are used; a parametric 
test usl!ig the student ”t’’ test statistic and a noiparametrlc test using 
the V/llcoxcn sl®ied rank test statistic. One reason for applying both 
tests Is that they require different assijrmptlons . The parametric t-test 
assumes the D values are normally distributed while the nonparametrlc test 
does not. The j d j values tuay be considered to be approximately normally 
distributed. The ( d | values ivould then be folded normals rather than nor- 
mally distributed.* Although both models are folded at [ d | 0, their means 

may be different and the distribution of D has a possibility of not being 
normally distributed. The t-test is robust with respect to the normality 
assumption; however, this possible violation of the assumption is one 
reason for also running the nonparametrlc test. 

The other reason for running both tests concerns the conditions under 
which the null hypothesis is rejected by each test. Using the parametric 
test, the basis for rejecting the null hypothesis is the average size of 

t 

the D values as compared to their variability. The t-test statistic is the 
average of the saiple standard error of the D's. The hypothesis will be 
rejected and the model with the smaller | d | values declared more reliable 
if t is large (either positive or negative). Howe'/er, it is possible that 
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one model could have a smaller | d | value for each of the test years, In 
other vwrds, be very consistent In outperforming the other irodel, and still 
the null hypothesis may not be rejected by the para;netrlc test unless the 
average value of D Is large enough. The parametric test Implicitly 
requires that one model have more years with smaller | d | values than the 
other model and explicitly re<iulres that , on the average, the | d | varies by 
a sufficient amount before tliat model may be declared more reliable. 

'Hie liypothesls Of equal model performance will only be rejected by the 
nonparametrlc test if one model has more years with smaller | d | values than 
the other rodel. The model with rore smaller | d | values Is considered the 
more reliable model In terms of consistency of performanoe. HowevePj to 
reject the null hypothesis and declare one model clearly better tlian 
another, consistency of performance Is not a sufficient requirement 
(although It is necessary). Consider the situation In which one model is 
more consistent than the other but the largest D values occur whai the less 
clnslstant model performs better. In the few years the less consistent 
model performs better, It performs much better, A dllerma exists since one 
model Is more consistent than the other but the bl^sjest differences between 
the models occur when the consistent model performs' ;«rse. The null 
hypothesis will be rejected only If one model Is more consistent and the 
biggest differaices betweai the models occur thte .consistent .*nodel per- 
forms better. 

MODEL COMPARISO N 

Quantitative comparison Is made below of the CEA3 and V/ll Liams- type 
models for spring wheat In North Dakota and Minnesota on the l»sls of boot- 
strap tests for test years 1970-1979. Reference Is also made In the tables 
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an4 some figures to the "Straviman" ?todel. T^ie Is an obJecti\re linear one- 
line fit to the years prarious to each test year, and thus represents a 
ininlinal ''mdel''^ Ihe straviman mdel contains no explicit weather-related 
liiformatlon. 

The actual SRS yields are plotted \rs. year from the 1930 'a through 1979 

for iHI in Figure 9 A and for tlD In Figure 2B. The results of the teh-year 

ixxDtstrap tests are plotted for MN in Figure 3A and for NB in 3B. An 

appendix presents the results of the ten-year bootstrap tests. 

Ihdloators o f Yield Reliability Based on 
d ■ Y - Y''Show the '6 eas ttodel Sllttintly More 
fecurate With Respect to Root Mean Square 
Sror. ditiridard Deviation, and Bias . 

Resiilts of comparative tests are shown In Tables 2,3 1 and 4 and Figure 2. 
RMSE The CEAS rrodel had smaller HliSE over the ten test years 1970-1979 at ' 
the CRD level in five of eleven GRD’s, while the WUllams-type model has 
smaller RT1SE In six CRD's (no ties). RMSE values for the GEAS model 
ranged from 1.17 to 4.18 Q/Ha at CRD level and from 1.13 to 2.09 Q/Ha at 
the state and regional levels. RMSE values for the WUllams-type model 
ranged from 1.49 to 3.76 Q/Ha at vGRD level and from 1.40 to 2.76 Q/Ha at 
state and regional levels. Average RMSE at CRD level was 2.01 Q/Ha for the 
CEAS model and 2. 1C QAla^ for the Wllllams-Type inedel, 
standard Deviation The standard deviation me-asures precision because the 
biases are all small, the standard deviations show the same pattern of 
behavior as RMSE values. 

Bias Biases for both models are amall. At CRD level the biases range from 
-0.73 to 1.68 Qz-Ha for the CEAS model and from -2.42 to 1.90 Q/Ha for the 
Wllliams-type model. Overall the average of the absolute value for bias at 
CRD level Is slightly smaller for the GSA3 model (0.25 Q/Ha) than for the 
WUllams-type movlel (0.54 Q/Ha). 


PAGE IS 
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Indicat o rs of Yi eld Reliabi lity B asad on 
rd ■ (d7^ * lOCf'gKowlshe 5 e1aS TOdel ^ " i 
3-lghtly Moro Accurate In Extr&ie Years », 

The model test results and comparative ranks for Indicators of yield 

reliability based on relative difference, rd, are given in Tables 5, 6, and 

« 

7 and Figures 5i 6, and 7. These indicators are valuable for demonstrating 
the worst performance of a model. The beat-performing nodal will bAve the 
smaller values for the percent of years the absolute value of relative dif- 
ference exceeds ten percent, and for the largest and next largest absolute 
value of the relative, difference. 

The percent of years In \^lch the absolute value of rd exceeds ten per- 
cent at CRD level was smaller or tied In eight cases for the CStlS nodel and 
In six cases for the V/llllams-type model. At state and regional level the 
CEAS model was better or tied In all cases; the WllLlams-type nodel was ** 
tied in three caises. 

The largest absolute relative dlffererice was smaller or tied at CRD 
level In eight cases for the CEAS model and In four cases for the Wllllams- 
type model. The CEAS model was better In al cases at state and regional 
levels. 

The next largest absolute relative difference was smaller or tied at 
CRD level In five cases for the CEAS model and In six cases for the 
V/llllans-type model. The CEAS model was better or tied in four of six 
cases at state and regional levels, while the WUllams-type nodel was 
better or tied In three of six cases. 
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lh« next largest absolute relative dirrerence ms smaller or tied at 
CRD level In six oases for the CEAS model and In five cases for the 
Willlams-type tnodel. The CEAS rindel xas better in five of six oases at 
state and regional levels, vAiUe the Will lam-type model was better In one 
case. 

Ihdlcators of Y ield Reliability Based on 
Y ’Stew the WS'5 tfedei With Bett^ 

" Response . ^ 

Plots of the predicted and actual yields over the ten test years for 
each state are displayed In Figures Z and 3. The test results and ootiH 
parative ranks for the Indicators of yield rellabllll?y based on Y and Y are 
given In Tables 8, 9, and 10, and Figures 8, 9, and 10, These Indicators 
demonstrate the degree of correspondence between predicted mi actual 
yields. The beat performing model will have the largest value for the per- 
cant of years In which the direction of change of Y’s from the previous 
year and from the average of the three previous years agrees with that for 
Y’s, ^d wLl have the largest value of the correlatlai coefficient between 
actijal and predicted yields. .. 

The percent of years 1ji v<hlch the direction of change frota the previous 
year Is correct is Larger or tied at CRD level in seven cases for the CEAS 
model and In six cases for the V;llllanis-type model , At state and regional 
level the CEAS model Is better or tied in two cases; the WUllams-type 
model is better or tied In four cases, i . 

The percent of years In which the direction of change from the average 
of the previous three years Is correct Is larger or tied at CRD level In 
eight cases for the CEAS model and in nine cases for the Willlams-type 
'.nodel. At state and regional level the CEAS model Is better or tied In 

t’wo cases; the Willlams-type model Is better or tied In .all six cases. 

-U- 


ORIGINAL RAGE 13 
OF POOR QUALITY 

The Pisarson correlation eoefriclent is larger at CRD level In six 

cases for the CEAS mdel and In five cases for the Williams-type model. At 

state and regional level the CEA3 model is better In four cases, vA)ile the 

WillittM-type model is better In two cases* 

Statistical Tests Based o n d ■ Y - Y 
Al ow the (SfeAs SlifliitlFletter . 

The results of the paramatrln and non-parametric paired - sample sta- 
tistical tests are shown Tables 11, 12, and 13 and Figures 11, 12, 13« 
and 14. 


In those cases where significant differences exists the CEAS model has 
smaller average 1 d ) than the Williams-type inodel one case for the para- 
metric t-test and has larger percent smaller | d | in one case for the non- 
parainetric rank test. Overall, considering both significant and non- 
significant cases, there is no dlacemable difference. 

Both Models Provide a Poor 
( ^irrent M ea sure of Modeled 
^eldn^Iiabillty 

The Spearman correlation coefficient between the estimate of the stan- 
dard error of a predicted yield frotn tlie base period model, sy, and the 
avsolute value of the difference between the predicted and act'ial yield, | d ( , 
Indicates wheft>ier the model provides a useful current measure of modelled 

yield reliability. An r value close to +1 is deslreable since it Indicates 

» 

♦ 

that a stnaller standard error of prediction ^and therefore a narrower con- 
fidence Interval about the predicted value) is associated with smaller 
discrepancies bet-ween predicted and actual yields. If this were the case 
one 'would have confidence in sy as (at least) a relative indicator of the 
accuracy of Y, 
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The results of the tests are given In Table 14 . The results for both 
are so poor and so variable that one can have little confidence In s^ as an 
indicator of the reliability of predictions i 

The TVo Models /^e About 
Bcuaiiy Ob^'ti^ 

Both (TDdels Involve 80<» subjectivity In specification of trend, choice 
of trend breakpoints, and stepvdse selection of the '’most sl^lf leant” 
terms. Both are quite objective In application once these choices have 
been :nade. 

Both Models Consi der K hovti 
" Scientific Relationships 
o n a feroad Sca le "But 

Stepwise selection of the most sl®ilflcant terms does not ensure physi- 
cal or biological sl0ilflcance for either model. Although the process gives 
tarns which represent general dependencies of yield on terrperature and pre- 
cipitation throu^ut the growing season, the vKlse variation from one 
region to another in terms which enter as ”sl®ilf leant” does not give a 
great of confidence in their reality. In general, the set of sisilf l- 
cant terms for regression modelsof these sorts seem to fall somewhere bet- 
v/een the poles of ’’physical reality” and ’’random fluctiiatlon”. 

The policy of handling technology and cropping practice trends by 
piecewise linear and/or quadratic ftjnctiona of year glosses over the known 
relationships to variety Improvements, fertilizer usage, etc., but Is 
currently the most practical way of handling a ver^ complex problem. 
Rationale for choosing brealqjolnts appears to be practical rather than 
scientific. There Is no kiown way to tell ’/<hen a trend breakpoliit has 
occurred until several years later. Because the trend breakpoints In both 
models were determined from exa't±natlon of all years throiij^ 1973-1979, 
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thera Is a certain amount of pre-lcioWledge in the testa that one vpoul4 not 
actualXy have In a real-life application* Neither model att«npts to expli- 
citly account for pests « disease, or other episodic events* 

Ihe use of textural and topographical Information In the Wllllams-type 
model does not appear to give this model any advantages In practice since 
these terms do not even enter some of the models where one would expect 
thetn from an agronomic viewpoint. It Is also not obvious if the CEAS 
models have any advantage In obtaining trends for each individual CRD as 

compared to the Vfllllams-type model which obtained trend for a multl-CRD 

« 

region. 

Both ^dels A re Adequate 
ClUy for tlwT&glons Iti 
which *lhey Were Developed 

Neither model can he reliably extended outside the regl<»i8 for which 
they were developed. Either can readily be built for any region for which 
a sufficient historical record of weather and yield exists. Tb some extent 
the V/llllams-type model allows substitution of geographical record for 
historical record and could, therefore, be at an advantage In certain 
foreign region)* of limited historical rebord. 

Both Models Are equally Timely 

New models can be built as soon as reliable yield and weather figures 
for the past year are available. Early season yield predictions can be 
!fjade shortly after the end of each month. In most CRD’s a ’’final” yield 
prediction \^uld be obtained as soon as weather data for July was obtained. 
This could be 1 to 5 weelcs before harvest. 
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Both Models Are Equally 
I haxininTlN^ to 1551^0^ Run 

Data to doyoXop and ran both modela are readily available at low cost. 
The iiultlple regression programs needed to develop and njn the models are 
available on most computer systems. 

Both Models Are Equally Simple 

For both models, development and application are straight-forward. The 
only points i^re Judgement Is required are in selection of sl^ilfloant 
terms and specification of trend. 

CONCLUSIONS 

By a small but consistent factor the CEAS model is preferable to the 
Wllllams-type model for predicting yields of spring Wheat at CRD and state 
levels In North Dakota and Minnesota. The CEAS ncdel Is more accurate, 
more precise, and more responsive to changes In observed yields. Both 
models are local models , but can be readily redeveloped for other regions 
for which historical records of 20-30 years of yield and monthly weather 
data exist. Neither model Incorporates scientific knowledge very deeply, 
and both are susceptible to large errors In years of unusual weather. 
Howe'/er, both models seem to generally do a good Job of relating weather to 
yield on average. Neither iiodel provides a useful current estimate of 
modeled yield reliability. 

The inalii practical difference between -the two models appears to be the 
pooling of CRD level! data cr/er mUltl-CRD regions. The fact that the 
pooled model for spring wheat did nearly as well as the models at Indivi- 
dual |CRP levels Indicates that the pool»3d approach is a feasible one. This 
could be useful In some foreign regions where historical record lengths are 
limited. 
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STATE COD 


AVERAGE PPO')Uf’TION A^^^ VIE'.D 
Fn9 TEST TEARS 1S70-7T 
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NORTH DAKOTA ANO MINNESOTA 
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Figure Ik 
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Figure ”B 
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Figure 3A 


TREND AND NONTHLr WEATHER 
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Figur* 3B 
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-*OOTH?28^koF,2g?*il|| !8§fST2t:sJK?CT4PE, 

OERtVEO F90M independent TEST yfiis 

TREND AND NONTH^T^KEAJHER DATA 9D0ELS 
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table 3 

MODEL COMPARISON BASED ON THE 
STANDARD DEVIATION (QUINTAlS/HECTARE) 
OERIVEO FROM .INDEPENDENT TEST YEARS 
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I97fi 

7.8 

14.4 

19.4 

19. 1 

0 , 6 

^.0 

1.3 

1979 

14.1 

18.6 

1 ^.9 

13.9 

4.5 

0.4 

-0.2 

90 

970 11.1 

14.5 

13.4 

1 4 , 4 

3.'* 

2.3 

3.3 


971 17,8 

1^.6 

16. ,3 

14. 1 

-3.2 

-1,5 

-3,7 


I'’-!’ 

15.4 

lrt.4 

17.6 

-0.2 

2.4 

1.4 


973 n.2 

16.2 

13.9 

11.8 

3.0 

0. 7 

- 1 4 


974 

4.7 

16.2 

ii 2 . 8 

14,7 

7.5 

4.1 

6i, 0 


975 14.2 

15.5 

15.3 

16.1 

1.3 

1 . 1 

1,9 


976 

l.l 

15.6 

13.1 

11,9 

4,6 

2,0 

0.4 


977 

I.O 

14,9 

14,1 

10,3 

3,9 

3.1 

-0*2 


97« 

5.6 

14,2 

18,6 

18.6 

^ 1 • ^ 

3.0 

3,0 


979 

2.2 

14.6 

W.o 

11.3 

2.4 

l.“ 

-0,9 




ORIGINAL page 13 
OF POOR QUALITY 


AppFi^iOIK 

^^HOOTSTRAP test »F.'>lil TS 
FOR «;oRIMG WHEAT Y FELDS r<l 
... . north DAKOTA AMO MImMESOTA 
.COMRAPIMO T»EH0 and monthly WFATMER data MDDEi s 
STmAm*STRAWMAN I WrLMSsWiLLI AMS TY»E CEAS*CEA5 moOFi 


ACTUAL OREOlCTEn 0» 

sT.re e,o 


M.OAKOTA 90 


STATE MnDEL 


CPOS AGOR, 


970 

9M 

972 

973 

974 
9 75 
97^- 
977 

975 
979 

970 
9 71 

972 

973 

974 

975 

976 

977 

978 
9 79 

970 

971 
9/2 

973 

974 

975 

976 

977 

978 

979 


14.3 

21 .5 

17.3 
IS, 9 
12v.9 

1‘?.3 
n .9 
17.1 

17.3 

17.3 


IS. 8 
21 .4 

19.4 

18. 5 

1?:Z 

16.6 

16.7 
2^1 

17.7 

I S.8 

21.4 

19.4 

18.5 
n.7 
17.4 

16.6 

16.7 

?0.l 

17.7 


16,3 


13.7 

13.0 

2.0 

-0,6 

-1.3 

16,7 


17,3 

16.3 

-4,8 

-4.2 

—3 . 0 

IS . 3 



21.7 

1.0 

1^7 

4.4 

IM .7 


13.9 

1 7.7 

2.8 

-i^o 

1«A 

I M ,9 


15.7 

1 7,7 

6,0 

2,8 

4,8 

I S . 8 


lb*a 

16,1 

3.5 

ils 

0.8 

18,6 


2.6 

14,1 

6.7 

0.7 

2,? 

17,6 


16.1 

16.0 

0.3 

-1.0 

-U 1 

17,5 


"}• ? 

1 7.3 

0.2 

2.0 

0.^ 

1 7 ,S 


6 .S 

17.4 

0.2 

-0.8 

0.1 

P^,S 

6.3 

15,8 

2.7 

O.S 

0.0 

18,9 

19,1) 

19.4 

-2.5 

-2.4 

-2,0 

2(1. 1 

20,9 

19.1 

n , f 

1.5 

-0.3 

2^.6 

16,4 

1 7.2 

2,1 

-2.1 

-1.3 

•! 


15,7 

7.4 

3,2 

2,0 

20. 

16, 1 

16,7 

ill 

•oil 

-0.7 

20.4 

16.1 

16,6 

3.8 

-0.5 

0.2 

19,9 

1 7 .J 

15.5 

3.2 

0.6 

-1*2 

19.3 

20.2 

18.1 

-o.s 

O.l 

-2,0 

1 /.6 

16,6 

1.7.2 

1.9 

-1.1 

- O.S 

18,6 

15.6 

16.1 

2.8 

-o.a 

0,3 

19.0 

IB. 6 

19,6 

-?.4 

-2.8- 

-1 . 8 

20.2 


0,4 

21.5 

0.8 

1.0 

2. 1 

20,7 

16.9 

18. 1 

2.2 

-1.6 

-0,4 

21. 1 


16.1 

7.4 

2.4 

2.4 

?0,5 

16.7 

17,1 

3.1 

-0.7 

-0,3 

20.4 

i 

6, 5 

16.6 

3.8 

-o!j 

0 

1 >.9 


16.0 

3.2 

0,3 

-0, 7 

19,1 

19, 7 

19.3 

-1.0 

-0,4 

-0.6 

19,5 

1 S .5 

1 6 . V 

1 .8 

-1.2 

-0.9 
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OWQ'WAL PAQ6 IS 
OF ^POOP QUAUTY 


APPPMOI* 

BnOTSTPAP T«iST PFSUI.TS 
POP SOWING (/HEAT VIELOS IN 
NOPTH OAKOTA ANO MT MNP SOT A 
COMPAPING TPEND ANO MOMTHLr wEAThEP OATA MODELS 
STMAN=STPAwMAM I wrLMS=WILLlAMS TYPE C£AS=C£AS MOOEl 


STATE 

ACTUAL 

VIELO 

CPD YFAP (0/M) 

ooEOICTEO 
YI'’LO (9/H) 

STM AN WILMS CEAS 

D* 

PPEOICTEO-ACTUAL 
5TMAN »TLM5 CEAS 

MINNESOTA lO 1 

070 

18.5 

21 #6 

18,7 

19.9 

'<•1 

0.2 

1.4 


: 

071 

26,9 

21.7 

22.4 

26.2 

•5 , 2 

-4,5 

-0.7 



972 

24.2 

21.2 

23.1 

25.7 

-1.0 

-0.9 

1.5 



971 

26,0 

21.9 


24,6 


-3.9 




974 

M.6 

24.8 

16.7 

?0.7 

6.2 

0.1 

2.1 


; 

97S 

22.7 

?4, 5 

20.6 

23, 2 

1.8 

-2.1 

0.5 


: 


24.6 

24.5 

21.1 

25.6 

-0,1 

-3,3 

1.0 



HI 

21.6 

2'».9 

21.4 

24, -4 



0.8 



978 

26,6 

2'*; 7 

22.9 


-1.9 

-1.7 

0.5 



1979 

24,9 

25.2 

21.2 

26,3 

0.3 

-3.7 

1.6 


40 

970 

18,4 

19,4 

17,9 

20.0 


-0.5 

1.6 



971 

21.3 

^0.0 

20,2 

?2.9 

-1.3 

-3,1 

-0.4 



972 

17.3 

21.4 

18.6 

21.4 

'8-1 

1.3 

4.1 



973 

26.7 

21.4 

20.2 

22.2 

-5.3 

-6.5 

-4 . 5 



974 

19,4 

22.9 

18.4 

22.8 

3.3 

-1 .0 

2.8 



975 

18.2 

23,2 

18.7 

22.3 

s.o 

0.5 

4.1 



976 

14,9 

22.3 

16.9 

19,3 

7.9 

2.0 

4.4 



077 

28,6 

21,5 

20.1 

21.1 

-7.1 

-8,6 

-5,5 



978 

17,3 

22 . 7 

19,8 

24 , 3 

'5.4 

2.5 

7.? 



979 

21.6 

22.0 

19.6 

24.6 

0.4 

-2.0 

3,0 

STATE 

model 

970 

18.6 

21.0 

19.1 

19.2 

2.<4 


0,6 

971 

2S.6 

21,2 

21.7 

24.2 

• 4 . 4 

-1 .9 

- 1 ,» 4 


' 

972 

22.2 

22.6 

23.7 

22.9 

0.4 


0.7 



973 

24.2 

21.1 

24.7 

24.-1 

- 1 . 1 

-1.5 

-1.7 



974 

19.5 

24 . 2 

21.2 

20.9 

4. 7 


1.4 



97S 

20.9 

24 , 1 

2 3.0 

22.0 

3.2 

^•1 

1.1 



976 

21,8 

23.9 

23.5 

24.4 

2.1 

1.7 

2.6 


. 

,977 

26.8 

21,8 

24,8 

•■> 4.4 

-3.0 

-2.0 

-2.4 



,978 

22.7 

2'-* ,4 

25.6 

85.3 

1.7 

2.9 

3.1 



1979 

21.6 

2'*,1 

2 S .9 

25,3 

0.7 

2.3 

1.9 

CP()S 

A GOP, 

1970 

18.5 

20.9 

18,4 

19.9 


-0.1 

1.4 


971 

2S.9 

21.2 

21 .8 

PS. 5 

-^.7 

- 4.1 

-0,6 



972 

22.3 

22.7 

82.0 

2'+ . 3 

0 

-0.3 

2.2 



973 

26.1 

23,1 

21.5 

2 3,8 

-1.2 

- 4,8 

-2.5 



.974 

18.9 

24.1 

18.6 

2 ] Ja 

5.2 

- 0,5 

2,4 



,975 

20,9 

24.0 

19,9 

22.9 

3.1 

-1.0 

2.0 



976 

20.9 

23 . 3 

19,6 

21 . 2 ' 


-1.4 

2.3 



977 

978 

2S.5 

21.3 

23.6 

24.0 

20,9 

21,8 

21.9 

26.2 

-1*9 

0. 7 

-4,6 

-1.5 

-1.6 

2.9 



1979 

23.8 

24,2 

20 .7 

25 . 9 

r »,^ 

-3.1 

2.1 
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ORiGlNAU PAQ6 » 
OF POOR QUALITY 


Appf'jo r H 

Bootstrap test results 

F09 SORING WHCaT YTFLns Iv 
NORTH DAKOTA AND MINNESOTA 
COMPAPING trend and MONTHLY WEATHER DATA MODELS 
STMANaSTRAloMAN 1 W TLMSsW ILL I Ams TYPE CiAS-CEAS ^OOE» 


STATE 


CRU YEAR 


actual 

yield 


PPEOICTED 


Os 


( 0 / H > 

STM an 

Wll.MS 

CEAS 

5 T*'»AN 

#ILMS 

G£AS 

16.1 

18.9 

15.9 

16,5 


- 0,2 

0.4 

22.0 

19,3 

19.1 

90,4 

• 8,7 

- 2,9 

- 1.6 


19.9 

20,6 


22.0 


0,7 

2.1 


19.9 

21.1 

1 7.7 

19,1 



- 0.8 


14.7 

?! ,7 

16.5 

17,1 

7.0 

1 . 8 - 

2.4 


18.1 

21 .2 

1^3 

ia .2 

3.1 

- 0.8 

0.1 


17,5 

21,1 

17.0 

1 . 8.2 

3,6 

- 0,5 

0.7 


18.7 

20,7 

1 7,9 

17,8 

2,0 

- 0,8 

- 0.9 

J 

» 0.7 

20.1 

20.1 

20.3 

- 0.6 

- 0,6 

0.1 

1^.9 

. 20.4 

1 7 . D 

18 . 7 

1.6 

- 1 .6 

- 0,2 

16.2 

18 . ■» 

16.6 

16.2 

2,6 

0.4 

0,0 

22.0 

19.2 

19,7 

20.1 

- 2.3 

- 2.3 

- 1.9 

19.9 

20 . S 

21.4 

19 . 7 

0,6 

1.5 

- 0.2 

19.9 

21.1 

1^9 

18.6 

1.2 

- 2.0 

- 1.3 

14.9 

21.8 

1 7,8 

16 . d 

6,9 

2.9 

1.9 

18.2 

21.3 

18.1 

17.5 

3.1 

- 0.1 

- 0.4 

17.9 

21 ..8 

18.0 

18.7 

3.4 

0,1 

0,8 

] 

19.3 

20 . 7 

19.3 

17.3 

1.6 

o.q 

- 1.5 


? 0,7 

20.4 

21,4 

1 Kb 

- 0,3 


- 0,9 

18.9 

20.6 

ia .6 

1 • 9 

1.7 

- ol 3 

0.0 


REGION 

CROS AG6R. 


STATES AGGR, 


1970 

1971 

{ 97 I 

1974 

1975 

1976 
197 7 
19 78 
1979 

97!) 

971 

972 

973 

974 

975 

976 

977 

978 

979 



NASA>JSC 


